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ABSTRACT 

This evaluation of elementary career awareness 
programs in Dade County Schools, Florida, compares student 
performance in seven schools receiving Education Consolidation 
Improvement Act (ECIA) Chapter II funds and six non-Chapter II 
schools. Pre-and posttest data from the Fadale Career Awareness 
Inventory revealed that the two groups did not differ on adjusted 
mean posttest scores. However, all Chapter II schools showed student 
performance gains beyond the .01 confidence level while only half the 
non-Chapter II schools showed performance at this level. Based on 
performance consistency, it was concluded that Chapter II funding did 
make a difference. Contrary to expectation, the presence of certified 
teachers and better equiped laboratories in the Chapter II schools 
did not explain this difference in consistency. Regression analysis 
of career lab instructor survey data identified four variables 
accounting for performance differences: (1) goal agreement between 
instructor and composite teacher; (2) career station preference 
diversity; (3) the number of work stations completed by students; and 
(4) the amount of class time spent on additional career experiences. 
Correlation of these variables with years of teacher career lab 
experience imply that with increasing experience, non-Chapter II 
school instuctors' performance improvement will increase uniformity 
of student performance. An inservice program would accomplish this 
goal more efficiently. Numerous appendices include the teacher survey 
questionnaire and statistical analyses and summaries. (BS) 
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. T ,r-; , v -v. :l\ , . . . Executive Summary 

'jjjjRiT.. In 1982-83 there were eighteen elementary schools 1n the system with elementary 
. ji *, . career awareness programs. The Department of Career Education requested Chapter 
p fjf*®/-f II funds to support career awareness instruction 1n seven of these schools. A 
. total of $198,297 \*as granted, to be used for salaries and fringes for seven 

teachers, and. for. supplies and materials. 

For comparative purposes/the schools which did not receive Chapter II support 
were Included 1n*the evaluation. Two major differences 1n the two groups were 
apparent at the outset: 1). all except one of the 7 Chapter II schools employed 
certified teachers as career lab Instructors, whereas all except one of the 11 
non-Chapter II schools employed assistants or aides 1n that capacity} 2) the 
Chapter II schools were better equipped than were the non-Chapter II schools 1n 
terms of the number of career work stations available for use. These differ- 
ences reflect the advantages of a relatively long history of special funding for 
career education programs 1n the Chapter II schools, six of which had previously 
received ESAA funds.. .„■ « 

Pre and posttest data on student performance were gathered 'from 5 Chapter II and 
6 non-Chapter II schools, using a published, standardized test, the Fadale 
Career Awareness Inventory. A comparison between the Chapter II and the non- 
Chapter II schools revealed that the two groups did not differ on adjusted mean 
posttest scores. The groups did differ, however, in the consistency of perfor- 
mance. Whereas all of the Chapter II schools reflected gains 1n student perfor- 
mance beyond the .01 level of confidence, only half (3 of 6) of the non-Chapter 
II schools showed performance at this level. Two of the remaining three non- 
Chapter II schools failed. to show gains at the minimum .05 level. On the basis 
of consistency of performance 1t was concluded that Chapter II funding did make 
a difference. v< 

It was" expected that this difference (In consistency) between the two groups 
would be explained by the presence of certified teachers and better equipped 
laboratories. In the Chapter II schools, j However, such was not the case. Al- 
though presence of teachers and quality of lab equipment were the most evident 
observable differences between the two groups, these differences did not, by 
themselves, contribute to an explanation ,pf differences 1n test performance. 

Using data collected in. a survey of career lab Instructors, and a statistical 
technique called regression analysis , four variables were Identified that 
accounted for differences In test performance among the 11 schools. These were; 

1. Goal Agreement (GA); a measure of the extent to which an individual 
instructor - whether certified teacher or not - was' in agreement with a 
composite teacher ranking, of selected career awareness goals. This 
variable was positively related to scores on the Fadale. The implica- 
tion of this finding is that, although the presence of a certified 
teacher in the classroom Is not critical, an orientation toward the 
goals of career education, congruent with that of certified teachers, 
is Important. 
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' rr V r 2. Career Station Preference (CSP) ; a measure pf the degree to which the 

Instructor agreed with a composite teacher ranking of the relative 
desirability of the Individual career work stations, This variable was 
negatively related to scores on the Fadale. That 1s, conformity to 
what teachers ? as a group tend to prefer 1n the way of work stations 
tended. to reduce effectiveness 1n teaching career awareness. The most 
reasonable Interpretation of this 1s not that teachers as a group make 
• poor choices concerning work stations, but rather that there 1s con- 
- slderable diversity 1n the needs of student populations, and that the 
.^i/.v V*>V. 1 effective Instructor gives precedence to this fact. 

3. Stations Completed (SC) ; the number of career work stations, on the 
average, that a student 1n a given school completed 1n an academic 
year. This variable was positively related to scores on the Fadale. 
The greater the number of stations completed, on the average, the 
•■ higher the Fadale scores tended to be. 

>. 

i. 

». 4. Additional Career Experiences (AE) ; the amount of class time spent on 

activities such as films, interviews, field trips, and research stud- 
ies. This variable was negatively correlated with student test per- 
formance. This would seem to Indicate that such activities as films, 
field trips, and the like do not contribute to career awareness learn- 
ing. However, this variable was defined 1n terms of the amount of time 
that Instructors reported *as set aside for these activities. It 1s 
possible, therefore, that AE indicates more about'how effectively this 
time 1s used than about the effect of such experiences on student test 
performance. . 

.'• All four of the variables described above were found to be correlated with the . 
' \ number of years of experience teachers had 1n the career labs. The AE variable 
was found to be negatively correlated with experience. The newer instructors 
tend to make the most use of "additional career activities." The other three 
variables are positively correlated with experience. 

The Implication 1s that, with Increasing experience, the instructors 1n the 
non-Chapter II schools can be expected to perform more like the teachers 1n the 
Chapter II schools, with accompanying increases in uniformity of student per- 
formance. However, an informed 1nserv1ce program would provide a more efficient 
means of accomplishing this goal, and could avoid the undesirable Increase in 
CSP (which while Increasing with experience tends to depress student perform- 
ance). 

Based on the analysis, the following recommendations are made: 

V 1. The elementary career awareness project should be refunded for another 

year. 

t' 2. The number of work stations completed per student should be Increased 

A ' * where feasible. 

3. Time spent on additional career experiences should be monitored to 
ensure that 1t 1s effectively utilized. 

4. Requests for support related to the provision of 1nserv1ce programs for 
career awareness personnel (such as the request for an educational 
specialist 1n the presept proposal) should be granted funds. 
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Background 

In 1982-83 there were career awareness programs 1n 18 Dade County .ementary 
schools. Seven received assistance from Chapter II funds, and 11 di . Six 
of the seven receiving Chapter II assistance had previously n J tSAA 
funding. At the request of the Director of Career Education, both ^-'oups of 
schools were Included 1n this evaluation. 

The two groups of schools (Chapter II and non-Chapter II) differ 1n a number ot 
ways, sometimes substantially. Some of these differences, useful as a perspec- 
tive for the evaluation, are described below. 

Table 1 gives selected Information on students and classes. Information 1s for 
the 4th through 6th grades, which are the grades receiving experience 1n the 
career labs. In addition, a few schools 1n both groups give classroom Instruc- 
tion 1n the lower grades. Also, not every school Includes 4th or 6th grades. 

TABLE I 

ELEMENTARY CAREER AWARENESS PROGRAM: 
CLASS AND ENROLLMENT STATISTICAL SUMMARIES* 



Schools 

Chapter II Non-Chapter II 



mean s.d. n 



mean s.d. n 



Number of students served 
(Grades 4, 5, 6) 



131.43 74.65 7 206.82 95.04 11 



Class size 



15.29 2.81 7 



17.36 8.78 11 



Length of class period 
(1n minutes) 



47.86 8.59 7 



49.55 11.72 11 



Classtime per week 

(in minutes) 112,14 30.12 7 121.82 35.16 11 

*Computed from survey questionnaire and/or telephone interview data. 
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It can be seen from Table 1 that the Chapter II schools serve fewer students on 
the average, although the large standard deviations Indicate that the number 
varies considerably from school to school 1n each group. 

Average class size 1s about the same 1n both groups, but varies greatly 1n the 
non-Chapter II schools. The same relationship holds for length of class period. 
The non-Chapter II schools offer more classtlme per week. 

Summing up, the non-Chapter II schools tend to serve more students than the 
Chapter II schools, and have more classtlme. However, they tend to vary more on 
all the Items 1n Table 1. They are more heterogeneous than the Cnapter II 
schools. 

Table 2 compares the two groups on the status of their career labs. There are 
33 "standard" work stations, which constitute the regular equipment of a career 
lab. The Chapter II schools have more of these stations (30 v. 24 on the 
average), and more of the stations they have are serviceable, according to 
reports of the career lab Instructors. Moreover, the Chapter II schools average 
3 additional "non-standard" stations per school, as compared to 1 for the non- 
Chapter II schools. 

TABLE* 2 

ELEMENTARY CAREER AWARENESS PROGRAM: " 
CAREER LABORATORY EQUIPMENT* 



Schools 

Chapter II Non-Chapter II 

mean s.d. n mean s.d. n 



Number of different 
standard stations 30.29 4.75 7 23.80 4.02 10 



Number of different standard 
stations serviceable 28.29 6.70 7 20.00 5.83 10 



Number of additional 
stations . 2.57 1.51 7 1.00 1.05 10 

♦Computed from data reported in survey questionnaire. 

This distribution of equipment illustrates the advantage of a relatively long 
history of special funding for programs in the Chapter II schools, compared to 



non-Chapter II schools. This observation is supported by results of a survey of 
the career lab Instructors. Of a 11st of potential problems, availability of 
materials was most often rated most salient by both groups. But of eight 
possible points (on a Llkert scale), the Chapter II group average was only 2.8. 
For the non-Chapter II group, the average was 5.3, well above the average for 
any other category listed.* (This list of obstacles may be found in the ques- 
tionnaire, 1n the Appendix A). 

One final point also reflects the relative disadvantage of the non-Chapter II 
schools. The Instructors 1n the Chapter II schools are more experienced than 
those 1n the non-Chapter II schools, averaging 4.57 years of career lab experi- 
ence, as compared to 3.55 years. This 1s confounded by another relevant vari- 
able. All but one of the seven Chapter II Instructors are certified teachers. 
Only one of the 11 non-Chapter II career labs 1s staffed by a teacher. The rest 
are assistants or aides. In general, 1t 1s the teachers who have the career lab 
experience, with a mean of 5.3 years as compared to 3.1 years. 

These differences perhaps help account for the differences 1n the way students 
are reported to use their time 1n the labs. Table 3 shows this Information. 
Students 1n the Chapter II schools spend considerably more of their lab time on 
station, although the variation 1s large for both groups. Consequently, the 
average number of station assignments completed 1n a year 1s greater for the 
Chapter II group. Conversely, students 1n the non-Chapter II schools spend more 
of their time on activities such as films, listening to guest speakers, and 
field trips. 
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*The Director of Career Education reports that as of this year, the non-Chapter 
II schools are well supplied wUh materials, and that the survey results re- 
flect the experiences of previous years. 
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TABLE 3 



ELEMENTARY CAREER AWARENESS PROGRAM: 
CAREER LABORATORY ACTIVITIES* 



Schools 

Chapter II Non-Chapter II 

mean s.d. n mean s.d. n 



Classtlme on station 
(minutes per week) 65.65 30.57 7 44.53 31.21 1U 



Stations completed in a year 4 17.33 4.36 6 13.83 3.92 6 



Additional career experiences 
(guest speakers, films, field 
trips, etc.) 

(minutes of classtime per week) 14.08 7.19 7 22.58 18.19 10 

♦Computed from data reported 1n the survey. — 
**In four of the 10 non-Chapter II schools reporting, students are not given 
career awareness instruction for a full academic year. 

Instructors in all the schools actively promote parent and community Involve- 
ment. All maintain a guest log, recruit speakers from various occupations, and 
hold a yearly career day open to the community. 

Two of the career lab teachers in 1982-83, in addition to their regular duties, 
visited the various' schools, providing information and assistance. Between 
them, they made 75 visits, logging over 1,800 miles. Beyond this, however, 
there was no formal inservice available for career awareness personnel. 



Description of the Project 

A proposal was submitted in April, 1982 for ECIA, Chapter II funds, in support of 
a project for Elementary School Career Awareness. The scope of the project was 
seven elementary schools, six of which had previously received ESAA funding. 

An amount totalling $269,542 was requested, the bulk of which (73$) was to go 
for salaries and fringe benefits for seven teachers. Additional funds were 
requested for salary and fringes for a project secretary, and for an educational 
specialist whose function was to be to provide inservice, liaison, and other 
support functions to the schools. A small amount was included for supplies and 
materials. 

6 



No specific relationship was stated 1n the proposal between the requested funds 
and the operation or outcomes of the project. The reason, perhaps, 1s that the 
career labs are already 1n place and functioning. Teacher's salaries and a 
minimum of supplies and materials are essentially the total support of career 
awareness 1n these schools. 

The proposal did suggest pre- and posttestlng with the Fadale Career Awareness 
Inventory (CAI) as an evaluation of student performance. Student performance, 
in turn, was linked to an approach, or "plan of attack", upon which career 
awareness Instruction 1n the Chapter II schools was to be based. This approach 
identified four factors: teachers; laboratory setting; additional career 
experiences; and parent-community Involvement. 

These four factors were selected - as the proposal states - on the basis of past 
experience, "because the performance of students [as measured by CAI gain 
scores] was outstanding". The Implication (although not specifically stated) 
would appear to be that: 1) the four identified factors represent important 
variables 1n career .awareness training; 2) they are amenable to manipulation 
from within the program; 3) changes 1n some or all of these variables are 
directly associated with changes 1n the level of student performance. 

The project was funded for a total of $198,297, providing salaries and fringe 
benefits for seven teacher:; (99%) and supplies and materials (1%). 

Description of the evaluation 

The initial Intent was to collect data on all the 18 schools with career aware- 
ness programs, and use the 11 schools not receiving Chapter II funds 1n a com- 
parison with those schools 1n the project. Although schools from both groups 
were Included in the analysis, it became necessary to eliminate a number of 
schools. Of the Chapter II schools, two were eliminated. One, the newest to be 
Included as a Chapter II school, was excused because of difficulties with pre- 
testing. The other was eliminated in the preliminary stages of analysis because 
errors Incurred 1n duplicating pretest answer sheets by hand proved too great 1n 
number for the data to be reliable. 

Five of the 11 non-Chapter II schools were eliminated. One was lost 1n mid-year 
when the aide teaching the career lab suffered an accident, terminating Instruc- 
tion for the remainder of the year. The other four were not Included because 
students in those schools did not attend career awareness classes for the full 
academic year. They were consequently not comparable in performance to students 
in the other schools. 

As a result of this attrition, the total number of schools Included 1n the anal- 
ysis was 11, five of which were Chapter II project schools. Pre- and posttest 
results were obtained for all these schools, on the Fadale Career Awareness 
Inventory (CAI), a published test which has been used 1n previous years. The 
total number of students for which matched pre-post scores were obtained for use 
in the analysis were 164 4th graders (from Chapter II schools only) and 378 5th 
graders. 
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Background Information and qualitative Insights were obtained through Interviews 
with the Director of the project and an experienced lab teacher, and through 
telephone Interviews, which were conducted with the teachers or aides/assistants 
of all the career lubs. In addition, several of the career labs were visited. 
On the basis of this, a questionnaire was constructed (see Appendix A) and sent 
to the teachers and aides/assistants. Information from this questionnaire was 
used to construct Indicators of a number of the variables used 1n the analysis. 

The analysis was begun with an Inspection of posttest gains, by school. Since 
no control w?s Included In the design, t-tests were used for this purpose. 
Next, analyses cf covarlance, with the pretest as covarlate, were applied to 
compare: 1) Chapter II schools with non-Chapter II schools; and 2) the schools 
which employ teachers for career lab Instruction, with schools which employ 
assistants/aides. 

Following this general analysis, a more specific Investigation was undertaken, 
based on a linear regression model suggested by the four Instructional factors 
put forward 1n the proposal. Indicators representing three of these factors 
were operationalized from data gathered 1n the survey of career labb personnel. 
These Indicators were run as independent variables in regression analyses using 
as the dependent variable residuals derived from regressing the CAI posttest on 
the pretest. The purpose was an attempt to determine which variables, 1f any, 
might yield the greatest Improvements for the least investment and effort. 

Results 

Group comparisons 

Overall, the results of testing with the Fadale Career Awareness Inventory were 
impressive. For the l?;6 4th graders (tested only in the Chapter II schools) the 
mean pretest score was 68.7 and the posttest mean was 81.3, an increase of over 
12 points. Similarly for the 378 5th graders from both Chapter II and non- 
Chapter II schools together, the posttest mean of 90.9 reflected an increase 
over the pretest mean of nearly nine points. 

The t-test results for all five Chapter II schools (both 4th and 5th grade 
classes) were statistically significant beyond the p ■ .01 level. For the six 
non-Chapter II schools tested, the results were significant at that level for 
only three. Trie significance level for one was at p ■ .034. Two failed to 
achieve significance at the p s .05 level. 

3. An analysis of covariance, however, with the pretest as covariate, failed to de- 
tect any significant difference between the two groups (F s 1.32 at 1 and 375 
degrees of freedom, p ■ .252). The adjusted posttest means differed by less 
than two points. 

* 

The reasons tor this lack of a difference are apparent upon .Inspection of Table 
4, which displays the adjusted posttest means by school 1n descending order. 
The two schools with the highest mean scores are non-Chapter II schools, &nd so 
are the lowest three. The non-Chapter II schools are widely disparate in mean 
student performance. In contrast, the means for the Chapter II schools cluster 
more closely together from mid-range upward. The difference between the two 
groups 1s not a mean difference, but one of consistency of schools within the 
group in producing increases in student performance. 
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Table 4 



ELEMENTARY CAREER LAB SCHOOLS: 
ADJUSTED CAI POSTTEST MEANS 



Adjusted 

School Mean Scores N 



One 


95.40 


94 


1 WO 


94.98 


37 


Three* 


94.05 


27 


Four* 


92.99 


22 


Five* 


92.26 


19 


Six 4 


89.32 


11 


Seven* 


88.38 


27 


Eight* 


88.27 


29 


Nine 


85.60 


39 


Ten 


82.46 


17 


Eleven 


81.88 


56 


Results of analysis of covarlance by 


school, with CAI pretest 


as covarlate: 






F * 7.69 df » 10, 367 p 


- .0058 





♦Asterisk denotes a Chapter II school. 



An alternative grouping of the schools produces a slightly different result. 
All except one of the Chapter II schools are staffed with certified teachers. 
None of the non-Chapter II schools tested are. When an ANCOVA 1s performed on 
these two groupings -teacher v. non-teacher - the resulting effect 1s to triple 
the value of the F ratio (F * 3.20 at 1 and 375 degrees of freedom, p a .074). 
Although st1 T 1 not significant at the p * .05 level, this effect may be Inter- 
preted as an Indication that the question of personnel 1s among those worthy of 
further Investigation. 

Regression Analyses 

Using data collected in the course of the evaluation, eight variables were 
created, representing three of the four factors specified in the proposal as 
Important 1n contributing to Improvements 1n student career awareness. These 
three were: 1) teachers (I.e., Instructor personnel); 2) laboratory setting; 3) 
additional career experiences. The data available were not adequate for the 
quantification of the fourth factor, parent-community relations. All of these 



variables are "school variables". Each student from the same school receives 
the same "score" on each. Detailed descriptions of the construction of all 
/arlables are given 1n Appendix F. 

These variables were treated as the Independent variables, and their relation- 
ship to the dependent variable, student performance, was conceived to be linear 
and add1t1ve(1 .e. , the models were linear regression equations). The dependent 
variable (called CAIR) was operational 1zed as the residuals of the regression of 
the posttest on the pretest scores of the Fadale Career Awareness Inventory. 
The subjects were the 378 5th grade students from the 11 Included schools, for 
which pre- and posttest CAI scores were available. 

The following discussion outlines the development of the analysis and points out 
the more Interesting results. The correlation matrix and complete commonality 
tables are given 1n the appendices. 

Career lab personnel variables . Four variables reflecting aspects of personnel 
Influences on student achievement were constructed. Two are straightforward 
measures. One, called "teacher presence" (TP), was a dummy variable reflecting 
the presence or absence of a certified teacher 1n the classroom. The other, 
labeled "years career lab" or YRS, was simply the number of years the teacher or 
assistant/aide had been a career lab Instructor. 

The remaining two, called "goal agreement" (GA) and "teacher-referenced career 
station preference" (CSP), are measures of the effect of the certified teachers' 
collective opinions on each other, and on the assistants/aides. GA 1s an Indir- 
ect measure of the degree of orientation to a composite teacher ranking of se- 
lected career awareness goals. The CSP variable 1s a measure of the degree to 
which the subject agrees with the composite teacher ranking of the relative de- 
sirability of the career work stations (and by Implication, the careers). 
Both are, by design, positively correlated with TP, and were constructed to 
represent "teacher orientation" qualities 1n all personnel. The dependent 
variable, CAIR, was regressed on these four variables and a commonality analysis 
performed. The four together accounted for a modest 11% of the variance. Table 
5 gives the unique contributions of each variable, and the variances held 1n 
common. One result that stands out, 1s that YRS dominates the equation, and TP 
makes only a small unique contribution. It does not follow, however, that 
experience 1s everything, and that teachers are not very Important to career 
education. 
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Table 5 



ABRIDGED* SUMMARY OF COMMONALITY ANALYSIS: 
REGRESSION OF C.A.I. RESIDUALS ON 
CAREER LAB PERSONNEL VARIABLES 



Variables 

1 2 3 4 

Teacher Presence Years 1n Career Lab Goal Agreement CSP 



r 2 with CAIR 


.0087788 


.0646398 


.0411992 


.0121988 


Unique to 


1 


.0133136 








2 




.0668458 








3 






.0043871 






4 


* 






. .0351844 


Common to 


1,2 


-.0125618 


-.0125618 






1,4 


-.0127208 






-.0127208 




2,3 




.0252447 


.0252447 






2,4 




-.0340836 




-.0340836 


Common to 


1,2,4 


.0139467 


.0139467 




.0139467 



*Only commonalities greater than |.0130| are Included. 



First, the effect of YRS 1s t:> suppress the TP effect. When YRS (and CSP, 
discussed below) 1s controlled, the contribution of TP Increases somewhat, above 
Its simple correlation with CAIR. This reflects the fact that some assis- 
tants/aides are also both experienced, and successful 1n increasing student 
performance. 

Second, the GA variable 1s influential almost exclusively through Its relation- 
ship with YRS. In term of Its simple (r 2 ) relationship with CAIR, GA 1s the 
second most Important of the four variables (after YRS), yet its unique contri- 
bution 1n the equation is nil. And aside from the (relatively) large variance 
held in common with YRS, 1t shares very little variance with any other variable. 
The Implication 1s that one Important factor in the experience gained from years 
in the career labs, is that of a learned agreement with a teacher-defined rank- 
ing of the goals of career education. 

The CSP variable exhibits a more complex relationship with student performance. 
Its unique contribution in the equation 1s triple that of Its simple (r 2 ) re- 
lationship with CAIR, indicating that Its effect is being suppressed by one or 
more of the other variables. In fact, the two suppressor variables are YRS and 
TP, when each is controlled separately. Yet when both are controlled together 
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In the presence of CSP, the three jointly share a contribution to explaining the 
variance 1n CAIR. This would appear to be due to the fact that the YRS effect 
1s also suppressed by the presence of TP. Presumably, CSP shares with YRS that 
variance that remains when the TP Influence 1s removed from YRS. 

Now, both CSP and 6A were constructed to reflect different aspects of the 
collective attitudes of the teachers 1n the program. However, they share almost 
no variance 1n common. They represent two more or less unrelated aspects of 
teacher orientation 1n the career lab personnel. Both CSP and GA are cor- 
related with YRS (r - .80 and r ■ .43 respectively) and both are strongly re- 
lated to 1t 1n contributing to the variance of CAIR accounted for. The con- 
clusion Is that CSP 1s a second (along with GA) Important consequence of career 
lab experience. 

The effect of CSP on CAIR, however, 1s opposed to that of GA. Where GA varies 
directly with CAIR (the higher the goal agreement of the instructor, the higher 
the performance of his/her students * tends to be), CSP varies Inversely. -(The 
modest positive simple correlation of CSP with CAIR appears due to the very high 
simple correlation of CSP with YRS. When both are entered in the same equation, 
the relationship of CSP to CAIR 1s negative). 

The Implication of all this for the career awareness program 1s as follows: The 
presence of a teacher in the career lab 1s not crucial. An orientation toward 
the goals of career education that 1s in agreement with a ranking established 
with teachers' attitudes, however, 1s Important. This orientation has Influence 
on student performance, not Independently, but through years 1n career lab, Im- 
plying that it 1s learned through supervision by and/or association with (other) 
teachers. 

The relative emphasis that the Instructor places on the different work stations 
1s also Important for student performance. With years 1n career lab, this 
emphasis tends increasingly to agree with the collective choices made by the 
teachers 1n the program. This tendency, however, runs counter to the tendency 
for student productivity .to Increase. More succinctly, Insofar as experience 
leads to conformity with what teachers tend to prefer concerning work stations, 
1t 1s likely to reduce effectiveness 1n teaching career awareness. The most 
reasonable Interpretation of this 1s not that teachers as a group make poor 
choices concerning work stations, but rather that there 1s considerable diver- 
sity in the needs of student populations, and that the effective instructor 
gives precedence to this need. 

Variables relevant to the laboratory setting . An additional four variables were 
constructed to study the effects of career lab activities on student perform- 
ance. All deal with aspects of the work stations. Variety of Stations (V) 1s 
simply the count of the different stations, present 1n the lab and serviceable. 
Classt1me-on-station (TS) 1s the Instructor's reported time per week, 1n 
minutes, that students spend on station. Stations Completed (SC) is the number 
of stations, on the average, that a student will complete In an academic year, 
as reported by the Instructor. . Finally, T1me-on-each-station (EA) 1s a 
composite of TS and SC, measuring the average amount of time spent on each 
station in the course of the year's instruction. 



12 

17 



Like the personnel variables, these four variables together account for only a 
modest amount of the variance 1n CAIR (9X). The relevant Information Is given 
1n Table 6. The variety of stations, V, contributes little to the equation. 
The number of different stations available 1s apparently not an Important factor 
in student performance. Time spent on station 1s of slight Importance, a part 
of its variance being shared with SC. The unique variance contributed by EA 1s 
relatively large, and Indicative of the presence of suppressor variables. Not 
suprislngly, these suppressors are TS and SC, the variables from which EA was 
constructed. 

Table 6 

ABRIDGED* SUMMARY OF COMMONALITY ANALYSIS: 
REGRESSION OF CAI RESIDUALS ON LABORATORY SETTING VARIABLES 



Variety of 
Stations 



Variables 
6 7 
Time on Stations 
Station Completed 



8 

Time on 
Each Station 



r 2 with CAIR 




.0000619 


.0179558 


.0322842 


.0017008 


Unique to 


5 
6 
7 
8 


.0085122 


.0187991 


.0558978 


.0313147 


Common to 


6,7 
7,8 




.0152017 


.0152017 
-.0141137 


-.0141137 


Common to 


6.7,8 




-.0204843 

i 


-.0204843 


-.0204843 
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The major variable 1n this group 1s SC, stations completed, with a unique 
contribution to the equation of 5.6X of variance. It would seem that this is 
the most Important factor of the laboratory setting. 

A limited m odel of career awareness instruction. A full or complete model of 
elementary career awareness Instruction, as it is conceived here, would Incor- 
porate variables representing all four of the factors mentioned in the proposal 
as responsible for Increasing student performance. As mentioned earlier, It was 
not possible at this time to construct a variable representing the fourth 
(parent-community Involvement). Thus the model presented here 1s United to 
Incorporating measures of the first three factors: teachers (I.e. career lab 
personnel); laboratory setting; and additional career experiences. 



The first 
variables 
used; for 
variable, 
minutes spent 
studies. 



and second factors are represented by some - but not all - of the 
previously presented. For the first factor, YRS, GA, and CSP are 
the second factor, SC and EA. The third factor is represented by one 
This variable, additional experiences, or AE, is the cUsstlme in 
on activities such as films, interviews, field trips and research 
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When CAIR 1s regressed on these 6 variables, the variance accounted for, while 
not large (R 2 ■ .146), 1s statistically significant well beyond the .001 level. 

Table 7 displays the main Information from the commonality analysis. Common- 
alities of the third order and higher (four or more variables sharing variance 
1n common) are not Interpreted here. Lacking any specific and accepted theory 
with which to relate the variables causally, these higher order commonalities 
are regarded as Indications of the lack of specificity of the variables em- 
ployed. The larger of these are Included 1n the table to Indicate the extent of 
this problem. 

TABLE 7 

ABRIDGED* SUMMARY OF COMMONALITY ANALYSIS: 
LIMITED CAREER AWARENESS INSTRUCTION MODEL 



2 

Yrs 

Career 
Lab 



3 

Goal 
Agrmt. 



Variables 
4 

CSP 



7 

Stat. 
Compl . 



8 

Each 
Time 
Sta. 



9 

Add 1 1 
Exper. 



r 2 with CAI 
Unique to 



.0646398 .0411992 .0121988 .0322842 .0017008 



,0824066 



Common to 



Common to 



Common to 



Common to 



2 
3 
4 
7 
8 
9 

2,3 
3,4 
3,7 
4,7 
7,9 

2,7,9 
3,4,9 

2,3,8,9 
3,4,7,9 
3,4,8,9 

2,3,4,8,9 
3,4,7,8,9 



.0049754 



.0159137 



.0337517 



.0148903 



-.0208706 



.0222126 



.0159137 
-.0173356 
-.0157744 



.0148903 
.0186985 
.0133689 

.0208706 
.0158119 



.0234498 



.0173356 
.0138472 



-.0167120 -.0167120 



.0186985 
.0133689 

.0208706 
.0158119 



.0201616 



.0157744 
.0138472 
.0195902 

.0337517 



.0186985 



-.0158119 



.0005706 



.0148903 

.0133689 

.0208706 
.0158119 



.0085006 



.0195902 

.0337517 
.0167120 

.0148903 
.0186985 
.0133689 

.0108706 
.0158119 



♦Only commonalities greater than J. 01301 are included, 
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Looking first at the variable YRS, 1t will be noted that Its unique contribution 
drops considerably when 1t 1s entered Into the larger equation. Much of Its 
variance 1s contributed through GA, SC, and AE. The rest 1s diffused among four 
or more variables. The suppressor effect on CSP has disappeared. This 1s not 
surprising. Like any "time variable", years 1n Career Lab 1s not Itself a 
causal variable, but a "holding variable 7 ', representing the time during which 
other variables are active. To the extent that these other variables can be 
identified and effectively measured, the holding variable's direct effect should 
be correspondingly .reduced. 

Three of these "other variables" now dominate the equation. The unique contri- 
butions of the variables GA, CSP, and SC are each significant beyond the .01 
level (none of the unique contributions of the remaining variables achieve 
significance at the .05 level). The conclusion from this 1s that, within the 
scope of the analysis, student performance tends to Increase as: 1) the In- 
structor's perception of the relative Importance of * career education goals 
approaches agreement with that of the teachers- as a group;- 2} the Instructor's- 
Independent judgment of the relative Importance of work stations in her lab 
Increases*; 3) the average number of stations completed by students 1n a year 
Increases. 

Of the two remaining variables, whatever effect EA makes 1s too diffuse to be 
Intelligible. The AE variable is more Interesting. Although Its unique contri- 
bution 1s small, Its simple correlations with YRS and SC are fairly strong, and 
all negative. It 1s precisely through these variables that AE contributes var- 
iance 1n the multiple regression. In terms of claistlme, additional career ex- 
periences compete with stations completed, and the less experienced Instructors 
tend to make the most use of 1t. This explains the moderate and negative simple 
correlation with CAIR. GA and CSP act as suppressor variables. 

The AE variable does not measure additional career experiences directly, but 
rather the amount of classtlme reportedly set aside for them. Because of this, 
the effects described above likely reflect more about how effectively this time 
1s used than about the effect of such experiences on student performance. 

Implications 

To sum up, R = .382 for the limited career awareness model, yielding an ex- 
plained variance of nearly 15 percent. The unique contributions of three of the 
variables (Goal Agreement, Career Station Preferences, Stations Completed) are 
each significant well beyond p = .01. . A fourth variable, Additional Career 
Experiences, has a unique contribution significant at .055. (A summary of the 
results of the limited model are given in Appendix K.) 



*Si«ice CSP is negatively related to CAIR, 1t decreases as student performance 
Increases. However, the CSP score is Itself a measure of the Instructor's 
agreement with the Index of teacher choices (of career work' stations) , and a 
low CSP score may be Interpreted as an Indication of an "Independent judgment" 
(Independent of the teachers' choice Index). It is this that is said to vary 
directly with student performance. 
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To understand what this means 1n terms of practical significance, recall that 
when the CAI pretest was controlled, a significant difference (p » .006) was 
found among the adjusted posttest means for the schools (see Table 4). This 
difference 1s the result of various effects which occurred during the school 
year under analysis, presumably 1n the career labs. 

Among those "various effects" are those represented by the four variables 
mentioned above. Since controlling the pretest screens out effects prior to the 
school year, then 1f these four are also controlled the resulting school 
posttest means should reflect only those Inter-school effects not accounted for 
by the regression model. That 1s, a second ANCOVA controlling for the five 
variables should show whatever differences among the schools remain after the 
effects of the variables Identified as Important for career awareness are 
removed. 

Comparing the results: 

a. ANCOVA 1 (CAI pretest as covarlate), F « 7.69, p ■ .006; 

b. ANCOVA 2 (five covariates), F * 1.64, p « .094. 

When the pretest alone 1s controlled, there are significant differences among 
the schools. When the four regression variables are added, the significant 
differences disappear. These four variables are by themselves sufficient to 
account for the differences that occur among the schools as a result of events 
that take place within the school year. (A complete summary of ANCOVA 2, 
Including all unadjusted and adjusted posttest means, 1s given in Appendix L.) 



Discussion and Recommendations 

The primary question to be addressed by this evaluation is, did Chapter II funds 
make any difference? The answer 1s yes. There 1s a difference 1n student per- 
formance 1n career awareness programs - as measured by the Fadale Career Aware- 
ness Inventory - between schools receiving Chapter II funding, and those which 
do not, when the schools are considered as distinct groups. While student per- 
formance 1n some non-Chapter II schools 1s outstanding, performance 1n others 
has shown no improvement at all. In comparison, student performance 1n all the 
Chapter II schools tested was significantly Improved in every case. It 1s this 
consistency of quality performance that sets the Chapter II grojp apart. 

Presumably this difference reflects the consequences of stable and adequate 
funding over a number of years. On the basis of this observation of perform- 
ance, the following recommendation 1s made. 

It is recommended that the elementary career awareness project be 
refunded for another year. [1] 

A second question follows: What can reasonably be done within the scope of the 
Program's resources, to help all participating schools become more uniformly 
successful in producing a high student performance in career awareness? This 
question requires some discussion. The reasons for the difference noted above 
are not immediately apparent. It was noted earlier that the two groups do not 
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differ 1n mean student performance. The two most obvious group differences 
(staffing by teachers 1n the Chapter II schools, and differences 1n how the labs 
are equipped) were found not to be of help 1n accounting for student perform- 
ance. 

Four variables were Identified 1n the analysis as contributing to the explana- 
tion of student performance: Stations Completed, Goal Agreement, Career Stations 
Preference, and (less directly), Additional Career Experiences. That the two 
groups differ on these variables Is shown In Table 8. 



TABLE 8 

COMPARISON OF CHAPTER II AND NON-CHAPTER II GROUPS 
OF SCHOOLS ON VARIABLES IDENTIFIED IN THE REGRESSION ANALYSIS 





Mean Group Scores 




Chapter II 


non-Chapter II 


Goal Agreement 


.660 


.369 


Career Station Preference 


.869 


.809 


Stations Completed 


16.709 


15.886 


Additional Career Experiences 


12.460 


16.890 



It was shown 1n the preceding section that these four variables are by them- 
selves sufficient to account for the differences 1n student performance that 
remain among the schools after the pretest effects are controlled. This is 
shown again, for the two groups, 1n Figure 1. In that figure, the lines between 
the unadjusted means and the means adusted for all five variables (Including the 
CAI pretest) are very nearly horizontal. There are virtually no observable 
differences between the two means for either group. The differences appear when 
only the pretest 1s controlled, with the expected results. (These results are 
muted when the schools are grouped, due to the aforementioned uneven perfor- 
mances of the non-Chapter II schools; see Appendix L for the listing of ad- 
justed means by school.) The mean posttest score for the Chapter II schools 1s 
adjusted upward, that for the non-Chapter I schools downward, demonstrating 
graphically the collective effect of the group differences in the variables 
shown In Table 8. 
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Figure 1 



EFFECTS OF CONTROLLING SELECTED VARIABLES ON THE CAI 
POSTTEST MEANS OF CHAPTER II AND NON-CHAPTER II SCHOOLS 



Group Means 




. Chapter II . . non-Chapter II 



*The five statistically controlled variables are: the CAI pretest; Goal 
Agreement; Career Station Preference; Stations Completed; and Additional 
Career Experiences. 



Consider first the directly measured variables. Stations Completed is directly 
associated with student performance. The more stations completed, the higher 
the CAI score tends to be. As a group, the Chapter II schools average nearly 
four more stations per year per student than do the non-Chapter II schools. 

It is recommended that the number of work stations completed per 

student be increased where feasible. [2] 
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Additional Career Experiences 1s negatively related to student performance. The 
more classtlme allotted to such experience, the lower student performance tends 
to be. Again the two groups differ 1n tne expected way. This time 1t 1s the 
non-Chapter II groups that spend more classtlme on Additional Career Experi- 
ences, nearly ten minutes more per week than the schools of the Chapter II 
group. The standard deviation 1s also large, Indicating that some non-Chapter 
II schools spend a great deal of classtlme on Additional Career Experiences. 
From these observations a third recommendation follows. 

It 1s recommended that the activities considered as "additional 

career experiences" be monitored to ensure that the time given 

over to them 1s utilized effectively. [3] 

The two remaining variables were designed to make some of the qualities associ- 
ated with certified career lab teachers Into non-d1chotomous measures, permit- 
ting those qualities to be observed 1n career lab Instructors who were not 
teachers. Goal Agreement 1s positively correlated with student achievement, the 
two Increasing togethar. Not surprisingly, given the variable's construction, 
the Chapter II group has the highest mean score. The Goal Agreement variable 1s 
one way of measuring the difference 1n the two groups 1n terms of career lab 
staffing (recall however, that one Chapter II school was staffed by an assis- 
tant, and one non-Chapter II school has a teacher). 

Career Station Preference 1s Inversely related to student performance, decreas- 
ing as the latter Increases. Once again the Chapter II group 1s higher, since 
the variable is referenced on the collective preference of teachers. In fhis 
instance the non-Chapter II schools have an advantage with the lower mean score. 
Both groups, however, average relatively high on this measure, with low standard 
deviations. The measure seems to reflect a nondeslrable influence of the teach- 
ers on non-teachers. 

One final fact brings these differences between Chapter II and non-Chapter II 
groups into coherent perspective. Taken across all 5th graders Included, in all 
♦■•he schools (N ■ 378), each of these four variables 1s moderately to strongly 
correlated with Years of Career Lab Experience. Both Goal Agreement (r ■ .43) 
and Stations Completed (r a .65) increase with years 1n career lab, whereas time 
spent on additional career experiences tends to decrease (r ■ -.57). There 1s a 
strong positive relationship between career stations preferred and years 1n ca- 
reer lab (r a .80), reflecting an unwanted consequence of length of service. 
The indication 1s that, to a great extent, strong scores in the "right" direc- 
tion on these variables are a product of years of association with the career 
awareness program. Years of career lab experience no doubt reflect both In- 
creases in learned competence in career awareness Instruction, and also a con- 
vergence of attitudes and perspective. This was 1n fact demonstrated in the 
commonality analysis, where each variable, at some point, shared relatively 
large amounts of variance with the YRS variable. 
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More years of experience 1n the career lab, then, 1s one answer to the second 
question raised above. It is not however, a very practical one. It seems 
likely though, that once the skills and attitudes acquired through that exper- 
ience are Identified, formal training would be one quick way to substitute for 
dme 1n helping to raise all the schools to the same level of performance. It 
would also be a more efficient way, since one unwanted effect of undirected 
experience (the convergence of preferences for the same set of career stations) 
could be deliberately avoided. A second recommendation follows from this 
reasoning. 

It is recommended that requests for support related to the provision 
of inservlce programs for career awareness personnel (such as the re- 
quest for an educational specialist in the present proposal) be granted 
funds. [4] 
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Appendix A 
OADE COUNTY PUBLIC SCHOOLS 

ELEMENTARY CAREER LAB 
TEACHER INFORMATION SURVEY 
Name School 



Position: (check one) Teacher 

Teacher Assistant 

I 

Teacher' Aide 



Years of Teaching experience (Dade County or elsewhere): 

Years of Career Lab teaching experience (include this year as one): 

In the columns below,, please list separately every career lab class that you 
are now teaching. 





Grada 


Number of 
Students 


Class Period 
(Minutes) 


Days Mat 
<M T M TH F) 


1. 










2. 










3. 










4. 










5. 










6. 










7. 










8. 










9. 










10. 










11. 










12. 










13. 










14. 










15. 










16. 










17. 










18. 






> 




19. 










20. 











Do you keep the same students all year (September through June)? Yes _ No 

If ho , then: (a) How many groups do you teach during the school year? 

(b) For how many weeks do you teach each group? 



BEST COPY AVAILABLE 
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CAREER LAB SURVEY (continue^ 

Following 1s a list of the original set of career awareness lab activities: 

A. In the first column to the right of the list (labeled A), please 
check (x) those stations which you have In your lab, whether or 
not they are In a condition to be used by students. 

B. In the second column (labeled B), Identify (x) those stations 1n 
your lab which are serviceable (i.e., in a condition to be used 
by students). 

C. In the third column (labeled C), please Indicate (x) the ten sta- 
tions you would choose 1f you had to furnish a career Tab with 
just ten activities to be chosen from this 11st. (No write-ins, 
please.) 

LIST OF CAREER LAB ACTIVITIES , 

' A: present m ffT equipment C: check 

Activity your lab? serviceable? choice. 

1. Adding Machine Operator 

2. Bricklayer 

3. Calculator Operator 

4. Cashier 

5. Cement Finisher , 

6. C1v1l Engineer 

7. Commercial Advertising Artist 

8. Cosmotology (manicure) ' 

9. Cosmotology (wig styling) 

10. Dental Hygenlst ' 

11. Dental Technician 

12. Doctor 

13. Draftsman 

14. Electrician 

15. Electronic Assembler 

16. File Clerk 

17. Fingerprint Technician 

18. Garment Worker 

19. Mechanical (adjusting carburetor) 

20. Mechanical (adjusting spark plugs) 

21. Mechanical (cleaning air filter) 

22. Mechanical Engineer 

23. Nurse (Patient's weight) 

24. Nurse (Using thermometer) 

25. Photograhlc Technician 

» 

26. Printer (Silk Screen) 

27. Printer (Sign Painting) 

28. Receptionist 

29. Secretary 

30. Sheet Metal Worker 

31. Tile Setter . ___ 

32. Typist 

33. Walter/Waitress 29 

Auh: MIS; Esjv Dale Feh », |9&) 



CAREER LAB SURVEY (continued) 

In reference to the 11st of career lab activities, or stations: 

A, Do you have stations 1n your lab that are not on the 11st? 
what are they? 



3. 



If so, 



B. Is (are) there any statlon(s) that you do not have In your lab, and 
which are not on the 11st, that you think would make an Important 
addition to your students* experience? Please specify. 



On the average, how many stations will a student complete In a year 
(September through June)? 



Proportioning Class Time 



At present, what 
proportion of your 
class time 1s spent 
(1n percent); 



1. with students on station 

2. lecturing and Instructing 

3. utilizing visitors, films, field 
trips, etc. 

4. other ways (specify) 



% 
'% 



Given a choice, how 
would you proportion 
your class time? 



% 



Total: 100 % 



100 % 



Audi* MIS; Exp Date F«K 28. 19d) 



CAREER LAB SURVEY (continued) 



Below Is a list of situations or conditions that might create problems for you 
1n meeting your objectives as a career lab teacher. To the right of each situa- 
tion listed is a broken line representing a continuum from "does not create a prob- 
lem" to "creates a problem". For each situation, place a mark at that point on the 
line which best reflects your judgement of how great a problem that situation cre- 
ates. If the situation Is not relevant to your lab, place a mark on the "non-ap- 
plicable" (N/A) column. 



V 



Students academically unprepared for material 

Presence of exceptional students 

Presence of Eng f I sh-as-Second-Language Students 

Students Indifferent to subject matter 

Too many students to be served 

Classes too large 

Not enough lab or Instruction time 
Availability of equipment and materials 
Clarity of program objectives 
Gaining acceptance of career lab by 
Gaining acceptance of career lab by 
Gaining acceptance of career lab by 
Gaining acceptance of career lab by 



Does not 
create a 
prob I em 



Creates 
a great 
problem 



parents 

community 
f acu I ty 

adrnl nlstrators 



N/A 



Given the.goals of the Elementary Career Lab Program, evaluate the relative Impor- 
tance of each of the fol owing objectives to the program by assigning a rank order 
from one (most Important) to seven (least Important) • 

RANK OBJECTIVE 



Identify the job title (and related job titles) of a number of workers. 
Demonstrate awareness of the educational requirements of jobs. 
Personally know workers In a variety of occupations. 
Distinguish between "product" occupations and "service" occupations. 
Be aware of the relative prestige or status of various occupations. 
Identify jobs as belonging or not belonging to certain job clusters. 
Associate specific preferences or abilities with certain occupations. 



OEA 01-10-83 
M0RRIS:nm1 

CARE/LAB/SUR-0, 1, 2, 3 



BEST COPY MAUbLt 



^ Audu MIS; Exp. DJte F<bt 2S. tm 
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Appendix B 
RESULTS OF T-TESTS 



Pretest 
Mean 



Posttest 
Mean 



df 



Chapter II Schools, 4th Grade 



76.26 


90.41 


33 


7.82 


.000 


63.30 


80.90 


19 


5.83 


.000 


61.11 


74.74 


34 


6.29 


.000 


71.63 


79.24 


M mm 

37 


3.48 


.001 


Chapter II Schools, 5th Grade 










72.19 


87.41 


26 


8.15 


.000 


68.79 


79.30 


26 


3.77 


.001 


79.00 


90.37 


18 


3.93 


.001 


96.18 


103.09 


21 


3.36 


.003 


82.17 


88.59 


28 


3.01 


.005 


Non-Chapter II Schools, 5th Grade 










87.71 


99.59 


93 


10.69 


.000 


87.81 


99.24 


36 


5.73 


.000 


68.92 


76.67 


38 


3.29 


.002 


85.55 


92.00 


10 


2.25 


.029 


72.71 


76.18 


16 


1.43 


.173 


84.32 


83.70 


55 


- .37 


.712 



0 
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Appendix C 



ANALYSIS OF COVARIANCE SUMMARY: 
COMPARISON OF CHAPTER II ANO NON-CHAPTER II GROUPS 

ON CAI POSTTEST 



K ■ 2 groups 

N ■ 378 fifth grade students 
Covarlate: pretest 



Source 


df ss x 


SP 


SS 


df 


SS' 


MS' y 








a y 




y 




Between 


1 1287.925 


479.878 


178.801 


1 


197.336 


197.336 


Within 


376 103091.480 


79016.392 


116670.045 


375 


56106.454 


149.617 


Total 


377 104379.405 


79496.270 


116848.847 


376 


56303.791 • 


XXX 




F - 1.318 


df 


* 1, 375 




p * .251 








b * 
w 


.766 










Group 


x mean 


y mean 




adjusted y 


N 


Chapter II schools (5) 


79.06 


89.06 




91.09 


124 


non-Chapter II schools (6). 


83.00 


90.62 




89.63 


254 



28 
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Appendix 0 
ANALYSIS OF COVARIANCE SUMMARY : 
COMPARISON OF SCHOOLS ON 
CAI POSTTEST SCORES 

K * 11 schools 

N ■ 378 fifth grade students 

CovaHate: pretest 



Source 


df 


SS 

X 


SP 


SS 

y 


SS' 


df 


MS' y 


Between 


10 


24844.130 


13978.384 

M 


31346.818 


9824.827 


10 


983.483 


Within 
Total 


367 
377 


79535.275 
104379.405 


05517.886 
79496.268 


85502.028 
116848.847 


46748.965 
56303.791 


366 
376 


127.729 
XXX 




F * 


7.692 


df « 10, 367 


P " 


.006 





b « .698 
w 



School 


x mean 


y mean 


adjusted y 


N 


1 


87.71 


99.59 


95.40 


94 


2 


87.81 


99.24 


94.98 


37 


3* 


72.19 


87.41 


94.05 


27 


4* 


96.18 


103.09 


92.99 


22 


5* 


79.00 


90.37 


92.26 


19 


6 


85.55 


92.00 


89.32 


11 


7* 


82.17 


88.59 


88.27 


29 


8* 


68.70 


79.30 


88.38 


27 


9 


68.92 


76.67 


85.60 


39 


10 


72.71 


76.18 


8«.\46 


17 


11 . 


84.32 


83.70 


81.88 


56 



indicates a Chapter II school 
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Appendix E 



ANALYSIS OF COVARIANCE SUMMARY : 
COMPARISON OF TEACHER AND ASSISTANT/AIDE 
GROUPS ON CAI POSTTEST 



K ■ 2 groups 

N ■ 378 fifth grade students 
CovaHate: pretest 



Source dT 



3F" 



S5" 



df 



SS'y 



MS 1 " 



Between 1 1635.887 369.612 
Within -376 102743.518 79126.658 
Total 377 104379.405 79496.270 



83.510 1 
■* 116765.337 --375 
116848.847 376 



476.877 
55826.913 
56303.790 



476.877 
148:872 
XXX 



3.203 



df • 1, 375 



b w - .770 



p ■ .074 



Group 



x mean 



Schools wi teachers, (4) 
Schools wi aldes/assts. (7) 



70T 
82.91 



y mean adjusted y 



"SOT 
90.41 



92.09 
89.48 



T 



"55" 
283 
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Appenoix F 



DESCRIPTIONS OF THE VARIABLES 
FOR THE REGRESSION ANALYSIS 

Y. CAIR, Career Awareness Inventory Pre-post Residuals. This variable 
consists of the residuals (Y - ?) from the equation ? » 27.90 + .76X, 
where X represents the CAI pretest. The N (378 5th graders) 1s the same 
for all variables. 

1. TP, Teacher Presence, is a dummy variable, with 1 representing a school 
with a certified teacher as career lab Instructor, and a 0 otherwise. 

2. YRS, Years 1n Career Lab, 1s the number of years of career lab experience 
an Instructor reported 1n the survey conducted in February, 1983, with the 
current year Included. 

3. 6A, Goal Agreement. The teacher Information survey questionnaire con- 
tained a 11st of seven objectives or goals (p. 4) which each Instructor was 
asked to rank 1n order of Importance. When the teachers' rankings were 
analyzed as a group (n • 7), Kendall's Coefficient of Concordance was 
highly significant (W • .499, p - .002). Following Siegal ( Nonparametric 
Statistics , 1957), this result was "Interpreted as meaning that the 
observers or judges are applying essentially the same standard 1n rank- 
ing..." (p. 237). The same test applied to the rankings of the assistants 
and aides (n * 10) was not significant (W - .169, p * .118). The pooled 
ordering of the teachers was then taken as a "standard," and a correlation 
coefficient (Spearman's rho) computed with each Instructor's Individual 
ranking, teachers as well as assistants and aides. These coefficients, 
constitute the scores of the Goal Agreement variable. Since the teachers' 
rankings were Included 1n the standard ranking, the measure is weighted 
toward them, yielding a nondlchotomous measure of one characteristic of 
the teachers 1n the program. 

4. CSP, Career Stations Preference. In the survey questionnaire, respondents 
were asked to choose, from among the 33 standard work stations, 10 that 
they would prefer 1f they had to build a new lab of only 10 stations. The 
choices of the teachers were then pooled and a rank ordering made of the 
standard stations, with the most often chosen station given the highest 
rank and rank number (33). This ordering was then regarded as the teach- 
er's collective ranking of the work stations from most to least Important. 
The rank numbers of the 10 choices of each respondent were then summed, 
and "normalized" with linear transformations Into a score ranging from 0 
to 1, where 0 represents complete lack of agreement with the ranking, and 
1 complete agreement. Again the construction 1s such that the weighting 
is in favor of the teachers, giving another nondlchotomous measure of an 
aspect of "teacherness". 
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5. V, Variety of Stations, 1s the total number of work stations 1n the career 
lab reported present and serviceable. The total Includes the 33 standard 
stations and any additional stations reported. 

6. TS, Time on Station, 1s the average minutes per week spent by students at 
work stations, computed as the product of total weekly classtlme 1n 
minutes and the percent/100 of time reported on station 1n the survey 
questionnaire. 

7. SC, Stations Completed, 1s the average number of stations that students 
complete 1n a year, as reported by Instructors. 

• 

8. EA, Time on Each Station, 1s made up as the product of time on station 1n 
minutes per week times 36 weeks, divided by the average number of stations 
completed 1n a year. 

9. AE, Additional Career Experiences, is the time In minutes per week spent 
on activities such as films, guest speakers, and field trips, computed as 
the product of total weekly classtlme 1n minutes and percent/100 of time 
reported for this activity 1n the survey questionnaire. 
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Appendix 6 
CORRELATION MATRIX 





Teacher 


Tears 


A_.«i 1 

Goal 




Variety of 


CI ass time on 


Stations 


Time on Additional 




Presence 


Career Lab 


Agreement 


C.a.r. 


Stations 


Station 


Completed 


Each Station Career Exper. 


i •ocntr rresence 


J AAAA 
















Tears uareer lad* 


OAT J 


1 •0000 














Goal Agreement 


•2494 


.4311 


1.0000 












C.S.P. 


•4479 


.7997 


.3189 


1.0000 










Variety of Stations 


•5628 


.6107 


.3696 


.8137 


1.0000 








CI ass time on Station 


•4942 


-.1712 


.2740 


-.3650 


-. 1676 


1.0000 






Stations Completed 


•3749 


.6468 


-.1662 


.6829 


.3805 


-.1469 


1.0000 




Time on Each Station 


• 1445 


-.3877 


.3706 


-.6129 


-.2762 


.8451 


-.6204 


1.0000 


Add* 1 Career Exper* 


-•2050 


-.5667 


-.1653 


-.3937 


-.1925 


-.0545 


-.5671 


.1771 1.0000 


CAI Residuals 


.0937 


.2342 


.2030 


.1104 


.0079 


.1348 


.1797 


.0412 -.2871 



C.A.I. 



1.0000 



BEST COPY AVAILABLE 



39 

38 
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Appendix H 



COMPLETE SUMMARY OF COMMONALITY ANALYSIS 
REGRESSION OF CAREER AWARENESS 
INVENTORY RESIDUALS ON CAREER LAB PERONNEL VARIABLES 



1 2 
Teacher Presence Years in Career Lab 



3 4 
Goal Agreement C.S.P. 



Unique to 1 
2 
3 
4 

Common to 1,2 
1,3 
1,4 
2,3 
2,4 
3,4 

Common to 1,2,3 
1,2,4 
1,3,4 
2,3,4 

Common to 1,2,3,4 

(r 2 with CAIR) 



.0133135715 



.0125618419 
.0048677495 
.0127208268 



•.0031723997 
.0139466899 
.0036217731 



.0087277159 
.0087788853 



.0668457991 



-.0125618419 



.0252446801 
-.0340835847 



-.0031723997 
.0139466899 

-.0003072321 

.0087277159 

.0646398266 



.0043870622 

.0048677495 

.0252446801 

.00570341 

■.0031723997 

•.0036217731 
.0003072321 



.0351844422 



-.0127208268 

-.0340835847 
.00570341 



.0139466899 
-.0036217731 
.0003072321 



.0087277159 .0087277159 
.0411992128 .0121988413 



ft2 y«1234 s .1111234621 



r ' 
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COMPLETE SUMMARY OF COMMONALITY ANALYSIS 
REGRESSION OF CAREER AWARENESS 
INVENTORY RESIDUALS ON CAREER LAB SETTING VARIABLES 

1 

i 







C 

9 

Variety of Station 


0 

T1me-on-Stat1on 


7 

Stations Completed 


8 

Time-each -Station 


Unique to 


5 


.0085122446 










6 




.0187991467 








7 






•05589/8473 






8 








.0313146536 


Common to 


5,6 


-.005516941 


-.005516941 








5,7 


-.0084983033 




-.0084983033 






5,8 


-.0064002937 






-.0064002937 




6,7 




.015201681 


.01520681 






6,8 




.005323785 




.005323785 




7,8 






-.0141136921 


-.0141136921 


Common to 


5,6,7 


.0059046236 


.0059046236 


.0059046236 






5,6,8 


.0076842827 


.0076842(^7 




.0076842827 




5,7,8 


.0073328402 




.0073328402 


.0073328402 




6,7,8 




-.0204843019 


-.0204843019 


-.0204843019 


Common to 


5,6,7,8 


-.0089565041 


-.0089565041 


-.0089565041 


-.0089565041 


(r 2 with 


CAIR) 


.000061949 


.017955772 


.0322841907 


.0017007697 



R2 y-5678 * .0920010686 



9 
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Appandlx J 



COMPLETE SOMARY OF COMMONALITY ANALYSIS 
CAREER AWARENESS INSTRUCTION MODEL 



2 

Yaart In 
Caraar Lab 



3 

Goal 
Agraamant 



4 

C.S.P. 



Stations 
Complatad 



8 



TIma-aach-Stat Ion 



Addltlona 
Caraar Expai 



Uhlqua to 



Common to 



Common to 



Common to 



i 

2 
3 
4 
5 
6 



,0049754177 



.0090748759 
-.0101422334 

.0121789337 
-.0025560615 
-.0114406196 

.0148903486 
-.0043084706 

.0004540109 
-.0025625009 
-.0004129054 



1,2,3,4 
1,2,3,5 
1,2,3,6 
1,2,4,5 
1,2,4,6 
1,2,5,6 
1,3,4,5 
1,3,4,6 
1,3,5,6 
1,4,5,6 
2,3,4,5 
2,3,4,6 
2,3,5,6 
2,4,5,6 
3,4,5,6 



1.2.3.4.5 -.0019147434 

1.2.3.4.6 .0114667046 
1,2,3,3,6 -.0208706209 
1,2,4,5,6 -.0084623684 
1,3,4,5,6 -.0024334286 
2,3,4,5,6 



Common to 1,2,3,4,5,6 .0099282806 



Comnon to 



<r* with CAIR) 



.0646398266 



.022212626 



.0234497811 



.0201616122 



.0005755759 



1,2 


.0159137034 


.0159137034 






1,3 


-.0038516321 




-.0038510321 




1,4 


.011203697 






•011203697 


1,5 


.0004748559 






1,6 


.0044843024 








2,3 




-.0173356178 


-.0173356178 




2,4 




-.0157744411 




-.0157744411 


2,5 




.0100462076 






2,6 




.0044438755 






3,4 






-.0138472014 


-.0138472014 


3,5 






.0093094421 




3,6 






.0078502723 




4,3 




- 




-.0005434152 


4,6 








.0195901678 


5,6 










1,2,3 


-.0013098534 


-.0013098534 


-.0013098534 




1,2.4 


-.0080774626 


-.0080774626 




-.0080774626 


1,2.5 


.0088445472 


.0088445472 






1,2,6 


.0129601935 


.0129601935 






1,3,4 


-.004120195 




-.004120(95 


-.004120195 


1,3,5 


-.0015799103 




-.0015799103 




1,3,6 


-.0017347681 




-.0017347681 




1.4,5 


-.0002773092 






-.0002773092 


1,4,6 


.0337516615 






.0337516615 


1,5,6 


8.423726E-05 








2,3,4 




.0123956776 


.0123956776 


.0123956776 


2,3,5 




.0018277781 


.0018277781 




2,3.6 




-.0167120339 


-.0167120339 




2,4,5 




-.0033565449 




-.0033565449 


2,4,6 




-.007878595 




-.007878595 


2,5,6 




.0054342757 






3,4,5, 






-.0026601921 


-.0026601921 


3,4,6 






-.0071725782 


-,0071725782 


3,5,6 






.0083957461 




4,5.6 








.0003121952 



.0004748559 

.0100462976 

.0093094421 
-« 0005434 152 
-.0001692079 

.0088445472 
-.0015799103 
-.0002773092 
8.423726E-05 

.001827781 

-.0033565449 

.0054342757 
-.0026601921 

.0083957461 
.0003121952 



erJc 



BEST COPY AVAILABLE. 



.008500575 



.004484302* 



.004443875! 



.007859272: 

.0195901671 
-. 000169207* 



.012960193! 

-.001734768* 

.033751661! 
8.423726E-0! 

-.016712033$ 

-.007878595 
.0054342757 

-.0071725782 
.0083957461 
.0003121952 



.0090748759 


.0090748759 


.0090748759 






-.0101422334 


-.0101422334 




-.0101422334 




.0121789337 


.0121789337 






.0121789337 


-.0025560615 




-.0025560615 


-.0025560615 


-.0114406196 




-.01 14406196 




-.01 14406196 


.0148903486 






.0148903486 


.0148903486 




-.0043084706 


-.0043084706 


-.0043084706 






. .0004540109 


.0004540109 




.000454010$ 




-.0025625009 




-.0025625009 


-.002562500S 






-.0004129054 


-.0004129054 


-.0004129054 


.005020302 


.005020302 


.005020302 


.005020302 




.0186985339 


.0166985339 


.0186985339 




.0186985339 


.0133688866 


.0133688866 




.0133688866 


.0133688866 


-.0058725921 




-.0058725921 


-.0058725921 


-.0058725921 




-.0028616546 


-.0028616546 


-.002861546 


-.002861546 


-.0019147434 


-.0019147434 


-.0019147434 


-.0019147434 




.0114867046 


.0114867046 


.01 14867046 


.0114867046 


-.0208706209 


-.0208706209 




-.0208706209 


-.0208706209 


-.0084623684 




-.0084623684 


-.0084623684 


-.0084623684 




-.0024334286 


-.0024334286 


-.0024334286 


-.0024334286 


-.0158118895 


-.0158118895 


-.0158118895 


-.0158118895 


-.0158118895 


.0099282806 


.0099282806 


.0099282806 


.0099282806 


.0099282806 


.0411992128 


.0121968413 


.0322841907 


.0017007697 


.0824065778 
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Appendix K 



SUMMARY DATA ON REGRESSION MODEL 
OF CAREER AWARENESS INSTRUCTION 





The equation, in standard 

2 y - . 


form: 

149Z 2 + .311Z 3 - 


.393Z 4 + .303Z 7 




. 047Z 8 


- .126Z 9 




R - .3824034435 












The variables: 


R 2 


F ratio 


df 


P 




All 


.1462323936 


10.59074656 


6, 


371 


7.301579E-11 


2. 


Years 1n Career Lab 
simple corr. 
last entered 


.0646398266 
.0049754177 


25.98418824 
2.162040294 


1, 
1. 


376 
371 


5.464568E-07 
.142304319 


3. 


Goal Agreement 
simple corr. 
last entered 


.0411992128 
.022212626 


16.15654078 
9.652374 


1, 
1. 


376 
371 


7.047298E-05 
.002036725 


4. 


Career Stations Preferred 
simple corr. 
last entered 


.0121988413 
.0234497811 


4.643408545 
10.18997292 


1, 
1, 


376 
371 


.0318074681 
.0015325743 


7. 


Stations Completed 
simple corr. 
last entered 


.0322841907 
.0201616122 


12.54382286 
8.761117276 


1, 
1. 


376 
371 


.0004474658 
.0032748677 


8. 


Time -on -each-station 
simple corr. 
last entered 


.0017007697 
.0005705759 


.640578888 
.2479406074 


1, 
1, 


376 
371 


.4240066478 
.6188239276 


9. 


Additional Career Experiences 

simple corr. .0824065778 
last entered .008500575 


33.76754073 
3.693877937 


1, 
1, 


376 
371 


1.32538E-08 
.0553781267 
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Appendix L 



ANALYSIS OF COVARIANCE SUMMARY: COMPARISON 
OF SCHOOLS ON CAI POSTTEST SCORES, WITH FIVE COVARIATES 



K = 11 schools 

N ■ 378 fifth grade students 
Covariates: 



CAI pretest, 

Goal Agreement, 

Career Station Preference, 

Stations Completed, 

Additional Career Experiences, 



bi = 



.7009642894 
10.22094306 
29.81729794 
1.089595503 
-.2850764594 



ANOVA of residuals 



Source 




df 

• 


SS 


MS 


Between 


• 


10 


2037.721 


203.772 


Within 




367 


45698.158 


124.518 


Total 




377 


47735.879 


XXX 




F ■ 1.636 


df « 10, 367 




p ■ .094 


Posttest means 












adjusted 




adjusted 


School 


unadjusted 


for Pretest 


for 


five variables 


1 


99.59 


95.40 




91.79 


2 


99.24 


94.98 




91.35 


3* 


87.41 


94.05 




92.79 


4* 


103.09 


92.99 




86.69 


5* 


90.37 


92.26 




87.58 


6 


92.00 


89.32 




95.97 


7* 


88.59 


88.27 




87.18 


8* 


79.30 


88.38 




88.99 


9 


76.67 


. 85.60 




91.19 


10 


76.18 


82.46 




85.31 


11 


83.70 


81.88 




89.19 



♦indicates a Chapter II school 
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